Image processing apparatus and method for image processing relevant images

ABSTRACT

An image processing apparatus is provided which includes a memory for storing plural photographic images, an input key for instructing a desired photographic image among the photographic images stored in the memory to be subjected to image processing, a determining section to determine whether a photographic image related to the photographic image which is instructed to be subjected to the image processing by the input key is stored in the memory, and an informing section to inform a user when the determining section determines that the related photographic image is stored.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a Divisional Application of U.S. applicationSer. No. 09/250,088, filed Feb. 16, 1999 now U.S. Pat. No. 6,795,116.

BACKGROUND OF THE INVENTION

The present invention relates to an image processing apparatus and animage processing method.

In image processing apparatus such as a digital camera, images of aphotographed object are recorded/stored on a recording medium in orderof taking the photographs. Therefore, in the case that a means forchanging display order is not set up, the images are reproduced anddisplayed in order of taking the photographs or vice verse.

Hitherto, the order of reproducing recorded images has been changed bydesignating images individually and inserting, between certain images,other image. Among digital cameras, however, cameras have been soldwhich have various modes such as a continuous photography mode and apanoramic photography mode, as well as a normal mode in which images arephotographed/recorded in an individual image unit.

In such cameras, according to the conventional method of changingreproducing order for individual images a part of images obtained bytaking photographs continuously or by taking panoramic photographs maybe inconveniently moved. As a result, there remains a problem thatrelevant images are dispersed.

BRIEF SUMMARY OF THE INVENTION

According to a first aspect of the present invention, an imageprocessing apparatus comprises: storing section for storing pluralphotographic images; instructing section for instructing a desiredphotographic image among the photographic images stored in the storingsection to be subjected to an image processing; and control section forperforming the image processing of an photographic image relevant to thephotographic image which is instructed to be subjected to the imageprocessing by the instructing section.

When a desired photographic image is instructed to be subjected to theimage processing, the photographic image relevant to the instructedphotographic image is also subjected to the same image processing.Accordingly, according to this image processing apparatus, it ispossible to prevent an inconvenience that relevant images, for example,images that are continuously or panoramically photographed, areprocessed separately.

According to a second aspect of the present invention, an imageprocessing apparatus comprises: storing section for storing pluralphotographic images; instructing section for instructing a desiredphotographic image among the photographic images stored in the storingsection to be subjected to an image processing; determining section fordetermining whether or not a photographic image relevant to thephotographic image which is instructed to be subjected to the imageprocessing by the instructing section is stored in the storing section;and informing section for informing, if the determining sectiondetermines that the relevant photographic image is stored, this fact.

When a desired image is instructed to be subjected to the imageprocessing, it is determined whether or not the photographic imagerelevant to the photographic image instructed to be subjected to animage processing is stored in the storing section. When the determiningsection determines that the relevant photographic image is stored, thisfact is informed. Thus, an undesired operation can be prevented.

According to a third aspect of the present invention, an imageprocessing method comprises the steps of: instructing an image storedrelevantly to other image to be subjected to an image processing; andperforming the image processing by the instruction and the imageprocessing of a photographic image relevant to the image subjected tothe image processing.

According to this image processing method, when a desired photographicimage is instructed to be subjected to the image processing, thephotographic image relevant to the instructed photographic image is alsosubjected to the same image processing. Accordingly, according to thisimage processing apparatus, it is possible to prevent an inconveniencethat relevant images, for example, images that are continuously orpanoramically photographed, are processed separately.

According to a fourth aspect of the present invention, an imageprocessing apparatus comprises: a memory for storing plural photographicimages; an input key for instructing by a user a desired photographicimage among the photographic images stored in the memory to be subjectedto an image processing; determining section for determining whether ornot a photographic image relevant to the photographic image which isinstructed to be subjected to the image processing by the input key isstored in the memory; and informing section for informing, if thedetermining section determines that the relevant photographic image isstored, this fact.

According to this image processing apparatus, when a desired image isinstructed to be subjected to the image processing, it is determinedwhether or not the photographic image relevant to the photographic imageinstructed to be subjected to an image processing is stored in thestoring means. When it is determined that the relevant photographicimage is stored, this fact is informed. Thus, an undesired operation canbe prevented.

Additional objects and advantages of the invention will be set forth inthe description which follows, and in part will be obvious from thedescription, or may be learned by practice of the invention. The objectsand advantages of the invention may be realized and obtained by means ofthe instrumentalities and combinations particularly pointed outhereinafter.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING

The accompanying drawings, which are incorporated in and constitute apart of the specification, illustrate presently preferred embodiments ofthe invention, and together with the general description given above andthe detailed description of the preferred embodiments given below, serveto explain the principles of the invention.

FIG. 1 is a block diagram illustrating an example of a circuit of adigital camera as an embodiment of the image processing apparatusaccording to the present invention;

FIG. 2 is a view illustrating an example of the formation of a groupinformation list;

FIGS. 3A to 3C are block diagrams illustrating examples of thestructures of a grouping means and the like;

FIG. 4 is a view illustrating an example of a group setting selectingmenu screen;

FIGS. 5A to 5D are views illustrating an example of a group data inputscreen;

FIGS. 6A to 6C are views illustrating an example of a grouping selectingscreen;

FIGS. 7A and 7B are views illustrating an example of a group selectingscreen;

FIG. 8 is a view for explaining a group-moving manner;

FIG. 9 is a view illustrating an example of the formation of a groupinformation list;

FIG. 10 is a view illustrating an example of a reproducing orderchanging screen;

FIG. 11 is a flowchart of an example of operation at the time ofregistering an image group automatically;

FIG. 12 is a flowchart of an example of operation when a user sets agroup; and

FIG. 13 is a flowchart illustrating an example of operation a the timeof grouping.

DETAILED DESCRIPTION OF THE INVENTION

FIG. 1 is a block diagram illustrating an example of a circuit of adigital camera (electrical still camera) as an embodiment of the imageprocessing apparatus according to the present invention.

In FIG. 1, the digital camera 100 has an optical system 11, a signalconverting unit 12, a signal processing unit 13, a DRAM 14, a serialinterface 19, a control unit 20, an operation unit 30, a display unit40, a ROM 45 for OSD data, a recording unit 50 and a power source 90.

In FIG. 1, the digital camera 100 may have a voice input/output unitsuch as a built-in microphone and a built-in speaker, and a voice storeso that messages can be informed by voice output instead of display ofmessages or the like in the display unit 40. A touch panel comprising atransparent film to which touch electrodes are fitted may be disposed ona liquid crystal screen of the display unit 40, and the camera 100 mayaccordingly have a handwritten character input unit for inputtingcharacters handwritten with a touch pen or the like, and a handwrittencharacter recognizing unit for recognizing the read handwrittencharacters and outputting character codes.

The optical system 11 includes an image pickup lens 111 and an auto irismechanism 112 and the like, and causes luminous flux, from an object,which is collected through the image pickup lens 111 to be focused,forming on image pickup elements (CCD) at the back.

The signal converting unit 12 includes CCD, a signal converting circuitand the like, and converts images formed on the CCD through the opticalsystem 11 in the upstream into electric signals so as to output theelectric signals as digital data in a constant cycle.

The signal processing unit 13 processes output from the signalconverting unit 12 to gain signal components such as digital multiplexsignals of brightness and color difference (YUV data), and thentransfers the YUV data to a designated area in the DRAM 14 and developsthe YUV data therein. Moreover, at the time of recording and storage theYUV data recorded in the DRAM 14 are read and are subjected to JPEGcompression processing while at the time of reproduction the image datastored and recorded in a recording medium (flash memory) 51 aresubjected to expansion processing so as to reproduce the YUV data.

The control unit 20 has a microprocessor structure including a CPU, aRAM, a ROM, a timer and the like. The CPU is connected to theabove-mentioned respective circuits and a non-illustrated power sourcechanging switch and the like through bus lines. The CPU controls thewhole of the digital camera 100 according to a control program stored inthe ROM, and performs and controls respective functions of the digitalcamera correspondingly to state signals from the operation unit 30, forexample, performs an image group automatically-registering means, agroup setting means 120 and a grouping means 130 and the like stored inthe ROM to perform grouping of images and processing for each of theimage groups, inform the existence of images belonging to the samegroup, and the like.

The operation unit 30 is composed of switches and buttons such as aprocessing mode changing switch, plural function selecting buttons, amain switch, a group-moving mode selecting button 36, a shutter button37, and a recording/reproducing mode changing switch. When theseswitches or buttons are operated, state signals are sent out to thecontrol unit 20.

The display unit 40 is composed of a display device such as a liquidcrystal display device, so as to display an image of an object at thetime of taking a photograph, a reproduction image at the time ofreproduction, a selecting menu (or an icon) at the time of selecting aprocessing, and a group changing/setting menu (or an icon) at the timeof displaying reproduction images. As described above, a touch panelmade of a transparent film to which touch electrodes or the like arefitted may be disposed on the liquid crystal screen of the display unit40 to input characters handwritten with a touch pen or the like.

The recording unit 50 records image data from the signal processing unit13 on the recording medium (flash memory in this embodiment) 51.

The flash memory 51 has not only areas in which image data are recordedbut also areas wherein recorded are an image data registering list forregistering, at the time of recording image data, conditions forphotographing the image and the like, and a group information list 60(FIG. 2) in which grouping data for the image (and the data) areregistered. The recording unit 50 registers the group number grouped bythe image group registering means 110 in the group information list 60,and registers the images (and the data) grouped by the image groupsetting means 120 in the group information list 60. The imageinformation registering list and the group information list 60 may beput in a single list.

In the case that the digital-camera 100 has a voice input/output unit,another voice memory may be fitted thereto, or an area for recordingvoice data may be disposed in the flash memory 51. Moreover, the flashmemory 51 may have an area for recording character data (includingsymbol data and icon data).

<Example of the Formation of the Group Information List>

FIG. 2 is a view illustrating an example of the formation of the groupinformation list 60, which has a data address registering column 61, aprocessing data and time column 62, an individual photography column 63,a continues photography column 64, a panoramic photography column 65, aclose-up photography column 66, a group input column 67 and the like. Inthe list 60, grouping information for voice data and character data, aswell as image data, can be registered.

In the data address registering column 61, the recording position(address) and size of not only image data but also voice data andcharacter data can be registered. In the processing data and time column62, the date when these data are registered or inputted is recorded.

From the individual photography column 63 to the group input column 67are group information registering columns. Among these, from theindividual photography column 63 to the close-up photography column 66are for grouping-data decided according to a photography mode at thetime of taking photographs. FIG. 2 illustrates 4 examples, that is,individual, continues, panoramic and close-up photography modes, but thephotography modes are not limited to these examples, and are allowableif they can be grouped at the time of taking photographs.

In the individual photography column 63, the photographic order ofimages photographed in other mode than special photography modes such ascontinuous photography, panoramic photography and close-up photographymodes, that is, in a normal photography mode is recorded as groupidentifying information (the group identifying information=the groupnumber=the reproducing order number in this embodiment). In the exampleshown in FIG. 2, the group numbers “2” and “3” are assigned to images ofthe data addresses “33”, and “34”, respectively.

In the continuous photography column 64, the group number ofcontinuously photographic images [images continuously photographed byreleasing the shutter one time (In this embodiment, 32 frames of imagesare photographed by releasing the shutter one time)] is recorded. In theexample shown in FIG. 2, the group number “1” is assigned to images ofthe data addresses “1” to “32”.

In the panoramic photography column 65, recorded is the group number ofa panoramic image that a view spreading out in the right and leftdirections or in the upper and lower directions is photographed toobtain plural images and then is cut and put together to display asingle image. In the example shown in FIG. 2, the group number “4” isassigned to images of the data addresses “45” to “47”.

In the close-up photography column 60, the group number of imagesphotographed in the close-up photography mode and having the same themeis recorded.

The group input column 67 is a column for assigning group numbers togrouped image data, voice data or character data in the case that a usergroups an image and another image, an image and data (voice data orcharacter data), or data and other data according to a certain relatedmatter. In FIG. 2, three columns 67-1 to 67-3 are arranged, but thenumber thereof is not limited to three. In the group input column 67-1in the example shown in FIG. 2, the number of data to be combined isshown as the group number, and continuously photographic images “1” to“32” are related to the voice data “n”. At the time of reproduction,therefore, the continuously photographic images “1” to “32” aredisplayed and additionally voice (explanation of the images, music orthe like) is outputted from the built-in speaker. As for the group inputcolumns 67-2 and 67-3, various combinations (for example, imagesphotographed in a certain destination) are put together at will to setup a group number thereto for grouping.

The group-registered images are reproduced in order of the group numberin this embodiment, but a reproducing order column may be separately setin the group information list 60 to manage group numbers and thereproducing order separately (FIG. 9).

<Module Structures of the Grouping Means and the Like>

FIGS. 3A to 3C are block diagrams illustrating examples of thestructures of the grouping means and the like. FIGS. 3A, 3B and 3Cillustrate structure examples of the image groupautomatically-registering means 110, the group setting means 120 and thegrouping means 130, respectively.

Each of the above-mentioned means may be composed of a hardware circuit,but is realized by a program and is stored in the ROM (or the flashmemory 51). Alternatively, it is allowable that a part of each of theabove-mentioned means is composed of a hardware circuit and the other isrealized by a program.

[Automatic Registration of an Image Group]

The image group automatically-registering means 110 is composed of aphotographing manner determining means 111, an image recording means 112and a group registering means 113, and groups images automatically atthe time of taking photographs and then registers the stored address,size, date when the photographs are taken, and group identifyinginformation (group numbers in this embodiment) in the group informationlist 60.

The photography mode determining means 111 examines a signal outputtedwhen the user presses the selecting buttons or points an icon to selecta suitable photography mode among, for example, the normal, continuous,panoramic and close-up photography modes, and then determines which ofthe photography modes is selected to store the result temporarily in theRAM of the control unit 20.

The image recording means 112 picks out image data of the photographicimage from the DRAM 14 after the shutter button is pressed, causes theimage data to be subjected to compression processing in the signalprocessing unit 13, and then records the image data in the flash memory51. In this case, image numbers, date of photographing, photographingconditions and the like may be recorded in a non-illustrated imageinformation list.

On the basis of the results which are temporarily stored in the RAM, thegroup registering means 113 decides in which column of the groupinformation automatically-registering columns 63 to 66 of the groupinformation list 60 group-registration is performed, attaches the samegroup number to the images photographed under the same photographingcondition, and stores the stored address and data size of the images,the date of photographing and time, and the group number in the dataaddress column 61, in the processing date and time column 62, and in thedecided group information automatically-registering column,respectively.

In the example shown in FIG. 2, the stored address and size for each ofcontinuously photographed 32 images, the date of photographing, and thegroup number “1” are stored in the data address column 61, in the dateof photographing and time column 62, and in the continuous photographymode column 64, respectively. Concerning panoramically photographicimages, the stored addresses and sizes for the respective images, thedate of photographing and time, and the group number “4” are stored inthe data address column 61, in the date of photographing and time column62, and in the panoramic photography column 62, respectively. Moreover,concerning normally photographic images, their stored addresses andsizes, the date of photographing and time, and the group numbers “2” and“3” are stored in the data address column 61, in the date ofphotographing and time column 62, and in the individual photographycolumn 62, respectively.

[Setting Groups By the User]

The group setting means 120 is composed of a group setting selectingmeans 121, a group data input means 122 and a group registering means123, and groups, with aid of operation by the user, images and/or imageswith corresponding input data at the time of photographing orreproducing the images and then registers the stored address, the size,the date of photographing and time, the input date, the groupidentifying information (the group number in this embodiment) of theimages or data which are members of the respective groups in the groupinformation list 60.

The group setting selecting means 121 performs menu display, icondisplay, (voice message output or the like) for urging the user to carryout the operation as to whether or not the object image displayed afterphotographing the object is grouped, and then examines the resultoperated by the user (the state signal sent out by button operationdesignated with the menu, a display guide or the like, by pointing theicon, or the like).

At the time of reproducing images, the group setting selecting means 121also performs menu display, icon display or the like as to whether ornor the reproduced images are newly grouped, and then examines theresult by the user. In the case that the shutter button 37 is pressed atthe time of photographing the images or an image forwarding button ispressed at the time of reproducing the images, grouping is notperformed.

In the case that the operation result stored in the RAM means thatgrouping is performed, the group setting selecting means 121 displays agroup setting selecting menu, (an icon or the like) as shown in FIG. 4to urge selection by the user. In FIG. 4, a photographic image orreproduced image is combined with the menu, but the menu (or icon) maybe displayed in another screen.

In the example shown in FIG. 4, a display screen displays the menus “thesame group”, “display an original image”, “add voice”, “add characters”and “end grouping”. However, menus to be displayed are not limited tothese menus.

The menu “the same group” means that images (including the displayedimage) photographed (or reproduced) hereafter belong to the same groupand these images are included in a different group from the group ofimages up to the selection of this menu (previous images).

The menu “display an original image” means that in the case that theuser-would like a displayed image to be included in the same group inwhich images transited to and already recorded in the group data inputmeans are included, the recorded images are scaled down to be displayedtogether with the displayed image.

The menu “add voice” is displayed in the case that in the circuit shownin FIG. 1 the voice input/output unit is added to the digital camera100, and means that voice input or voice data registered in the ROM 45or the voice memory are caused to be included in the same group in whichthe displayed image is included.

The menu “add characters” is displayed in the case that in the circuitshown in FIG. 1 the handwritten character input unit and the characterrecognizing unit are added to the digital camera 100 in order that theuser can input a character message or the like, and means that thecharacter message or the like inputted by the user is caused to beincluded in the same group in which the displayed image is included.

When the menu “end grouping” is selected, it is meant that a series ofgrouping is ended, and the screen again displays the menus “the samegroup”, “display an original image”, “add voice”, “add characters” and“end grouping”.

At this time, if the menu “end grouping” is again pressed or the shutterbutton 37 or the reproduction image forwarding button ismerely-operated, non-grouping is regarded.

The group data input means 122 has a scaling-down means for scaling downrecorded images and reproducing them and a display means for displayingthe scaled-down images together, each of which is not illustrated. Thegroup data input means 122 displays an input guide corresponding to eachgrouping manner selected by the group selecting means 121 so as to urgethe user to input grouping data, and then stores the input datatemporarily in the RAM. For example, in the case that the menu “the samegroup” is selected in FIG. 4, the group data input means 122 displays agroup number, and the symbols “+” and “−”, as shown in FIG. 5A, so thata suitable group number can be inputted.

In the example shown in FIG. 5A, the group number “6” is displayed.Thus, if the user presses a confirming button (for example, a functionbutton) or points the displayed group number “6”, the group number ofthe displayed image is inputted as “6”. When the symbol “+” is pointed,the group number increases one by one. On the other hand, when thesymbol “−” is pointed, the group number decreases one by one. Thus, ifthe user inputs the confirmation button when a desired group number isdisplayed, the user can input the group number of the image as thedesired number. Moreover, if the displayed group number, for example,“1” is pointed, the user can input the group number of the image as “1”.

Instead of the user's input, for example, a group number which is notused may be automatically assigned.

Without group numbers being inputted for respective images, it isallowable that at the start of photography (or reproduction) a groupnumber is once automatically or manually assigned and then the samegroup number is assigned to images or the like photographed (orreproduced) thereafter.

In the case that the menu “display an original image” is selected, thegroup data input means 122 scales down images recorded in the flashmemory 51 to reproduce the image as shown in FIG. 5B, and displays thesymbols “+” and “−” and, if the recorded images have a group number, thegroup number, together with the presently-displayed image.

In the case that the user would like the presently-displayed image tobelong to the group of the recorded images or to be grouped into therecorded images and that the image number of the group is unclear, thesymbol “+” or “−” is pointed so that the scaled-down images can bequickly forwarded and displayed to search the recorded images of thetarget group. When a desired scaled-down image is displayed, thescaled-down image can be pointed to input the group number of thescaled-down image as the group number of the displayed image.

In the case that the menu “add voice” is selected, the group data inputmeans 122 displays a message for urging the user to input voice as shownin FIG. 5C. The user can point the display guide “start”, “end”,“confirm”, “input again”, “OK” or the like to perform the start, end,confirmation, repeated input, final confirmation or the like of thevoice input.

The input voice is converted into voice data to store the data in thevoice memory or the voice data recording area of the flash memory 51.Additionally, the memory position and the group number (=the groupnumber of the displayed image) of the voice data are temporarily storedin the RAM.

In the case that the menu “add characters” is selected, the group datainput means 122 displays a message for urging the user to input acharacter message as shown in FIG. 5D. The user can use an input pen orthe like to input a character massage or the like in the input column onthe screen. The inputted handwritten characters or the like arerecognized so that a character code stream for them is stored in thecharacter data recording area of the flash memory 51. Moreover, thestoring position and the group number (=the group number of thedisplayed image of the character data is temporarily stored in the RAM.In FIG. 5D, the user can end the character input, correct the inputtedcharacter and perform page-exchange, in the case that the input columnis insufficient, by pointing the display guide “end”, “correct” or“continue”.

The group registering means 123 registers, in the group information list60, the group number inputted through the group input means 122 andtemporarily recorded.

In this case, the group number stored in the RAM is registered the groupinput column 67 of the group information list 60 when the menu “the samegroup” or “display an original image” is selected. In the case that thedisplayed image is a recorded image which is not grouped at all (forexample, a transmitted image) and the menu “the same group” or “displayan original image” is selected, the storing position, the date ofphotographing, and the group number of the displayed image areregistered in the data address column 61, the processing date and timecolumn 62, and the group input column 67 of the group information list60, respectively. (In this embodiment, other images than transmittedimages are registered in the group information list 60 because, at thetime of recording images, the images are automatically group-registeredby the image group automatically-registering means 110.)

In the case that the menu “add-voice” or “add characters” is selected,the storing position, the input date and time and the group number ofthe voice data or the character data stored in the RAM are registered inthe data address column 61, the processing date and time column 62 andthe group input column 67 of the group information list 60,respectively.

[Grouping]

The grouping means 130 is composed of an image reproducing means 131, aprocessing selecting means 132, a related data informing means 133 and agrouping performing means 134, and performs movement (insertion andremoval), change of reproducing order, transmission of recorded data,print of images, display and the like in each group unit at the time ofreproduction. In this case, if there are images belonging to the samegroup, the existence of them is informed to the user by a voice message,a character message, icon display or the like.

The image reproducing means 131 reproduces the data recorded in theflash memory 51, in the same way as image-reproduction in the normalmode, to display images on the screen of the display unit 40 in the casethat the grouping mode is selected. In order to make selection of imagesby the user easy, the image reproducing means 131 can also search thegroup information list 60 (in order of the group number in thisembodiment), and display it with quick forward of it (FIG. 6A).

When a desired image is displayed, the processing selecting means 132displays a processing selecting guide (menu) together with the desiredimage to urge the user to select a processing (FIG. 6B). In this case,plural processings may be selected. In the example shown in FIG. 6B, ifdesired and necessary guides are pointed among the guides [move],[change reproducing order], [transmit], [print], and [display] in orderto select plural processings, each of the corresponding processing flagsis turned on (=1). If the user points the guide [inform], the presentoperation is transited to the step by the related data informing means133. If the guide [all] is pointed, all processings ([move], [changereproducing order], [transmit], [print], and [display]) flags for agiven group are turned on.

A: Informing of Related Data

The related data informing means 133 searches the group information list60 on the basis of the group number of the image displayed at present,and then informs, if the fact is found that there are images, voice dataor character data having the same group number, the user of this fact bya voice or character message. In this case, the user can reproduce andwatch the images of the same group in sequence, or reproduce the messageto confirm the selected processing. When the confirmation of theinforming, and the like (including non-confirmation) by the related datainforming means 133 are finished, the operation is transited to the stepby the grouping performing means 134 (FIG. 6C). In this embodiment theinforming is performed when the user points the guide [informing] in theprevious step, but automatic informing may be carried out at the time ofselecting a processing (or displaying the desired image).

B: Grouping

The grouping performing means 134 has sub-modules such as a moving means134-1, reproducing order changing means 134-5 and the like. After theconfirmation by the related data informing means 133 is finished, aprocessing designated by the processing selecting means 132 is performedin the corresponding sub-module.

(1) Moving and Deleting

The moving means 134-1 displays a movement instructing guide as shown inFIG. 7, together with a displayed image so as to urge the user to giveinstructions on a moving manner, a moving destination, and the like. Byinstructing movement or deletion of a desired image and the like, imagesetc. (meaning grouped images, and voice data or character data. This isthe same hereinafter.) are moved or deleted in a group unit.

Group-Moving (Inserting)

When the guide “group-move” is selected in the example shown in FIG. 7A,the group number of an image which is selected by the image reproducingmeans 131 and displayed at present and to which “moving” processing isinstructed by the processing selecting means 132, that is, an image tobe moved (an original position image) is displayed at the mark [?] ofthe “original position=[?]” (FIG. 7B). In the example shown in FIG. 7B,“original position=[1]” (continuously photographic images in the exampleshown in FIG. 2) is displayed.

In this case, the group number of the original position can again be setup by displaying images in order of their group numbers and selecting adesired image.

Next, image display is performed in order of their group numbers if thesymbol “→” is pointed. Thus, in the case that there is a position wherethe user would like to move the original image, the user points thesymbol “destination<[?]” of the image (the group number “4”) displayednext to the above-mentioned position, the state of “original position[1]→destination<[4]” arises. Thus, the images etc. of the group number“1” can be moved before the images of the group number “4”, that is,between the images of the group numbers “3” and “4”, and further thegroups of “3” or later can be renumbered.

In short, in the case that the images etc. of the same group in whichthe image to be moved is included are stored, they are together moved ina designated destination.

When the user knows the group number of the original position or thedestination, the group number may directly be inputted in the [?]. Inthe example shown in FIG. 7A, in the case that the images etc. of thegroup number “1” are moved at last, the user sets the state of the“original position [1]→destination [E]”.

If in the example of the group information list 60 shown in FIG. 2 thestate of the “original position [1] destination<[4]” is set, the controlunit 20 logically moves the images etc. without physical movement byrewriting the group numbers “2”, “3” and “1” into “1”, “2” and “3”,respectively, as shown in FIG. 8.

In this way, images are displayed in each group unit thereof and inorder of the group numbers at the time of reproducing the images. At thetime of outputting the images, the images are outputted in order of thegroup numbers. FIG. 9 shows the storing state on the group informationlist 60′ for the group-moved images etc. In the example shown in FIG. 8,the groups numbers “2” and “3” in the individual photography column 62shown in FIG. 2 are rewritten into “1” and “2”, respectively, and thegroup number “1” in the continuous photography column is rewritten into“3”. When the guide [confirm] is pointed in the screen shown in FIG. 7B,the moved group images are displayed.

Group-Deleting

In the case that the user selects the guide [group-delete] in FIG. 7A,by inputting a group number or designating the displayed image, otherimages etc. of the same group in which the selected image is included,if any, can be deleted at a time. Concerning the group-deleted imagesetc., their previous group number is substituted by “0” on the groupinformation list 60. Any images etc. having the group number “0” are notsubjected to processing in a grouping mode so far as the guide [restore]in FIG. 7A is not designated.

Group-Restoring

In the case that the guide [group-restore] in FIG. 7A is selected, thegroup-deleted images etc. and their group number aredisplayed/outputted. The user can automatically give the images a newimage group number (that is, the final number which is not used) bypointing the mark [?] of the guide [number], and can process therestored images etc. in the grouping mode by storing it in the groupinformation list 60. Moving (inserting), deleting and restoring in eachimage (or data) unit

Moving (inserting), deleting and restoring in each image unit, which arenot those in each group unit, can also be performed by pointing theguide “image unit” in FIG. 7A. In the case that the processing in animage unit is performed, the image group number of the image issubstituted by “0” on the group information list 60. In thenon-illustrated image information registering list, rewriting processingfor the inserting, deleting, restoring or the like is performed.

(2) Change of Reproducing Order

The reproducing order changing means 134-2 is a means which functions inthe case that the reproducing order column 68 is set to the groupinformation list 60 as in the group information list 60′ shown in FIG.9. This means is selected in the case that only the reproducing order ofimages is changed without movement of the images. When the reproducingorder is changed, the result of the change is stored in the reproducingorder column 68.

When the user points, for example, the guide [change reproducing order]in the example shown in FIG. 10, group images are in turn displayed andthe “group numbers” and reproducing order thereof are displayed. In thecase that the user would like to change the “reproducing order”, theuser can change the reproducing order by inputting or designatingdesired reproducing order numbers. In the case that the reproducingorder is not changed, the group numbers are equal to the reproducingorder numbers. However, when the reproducing order numbers are changed,the reproducing order is automatically moved.

When the image of the reproducing order number “38” is changed to, e.g.,the reproducing order number “2”, the content in the reproducing ordercolumn 68 of the group information list is automatically changed asfollows: “38”→“2”, “2”→“3”, “3”→“4” . . . “36”→“37”, and “37”→“38”. Whenthe user points the guide [reset], the reproducing order is reset so asto be the same order as that of the group numbers.

The transmitting means 134-3 transmits data on images etc. belonging tothe same group to an external device through the I/O interface 19.

The printing means 134-4 subjects image data on images belonging to thesame group to expansion processing and processing for convertingprinting data, and then transmits the resultant data to a printerthrough the I/O interface 19 to perform color printing of images. Theprinting means 134-4 also makes it possible that the user designates thenumber of print sheets, a print size and the like.

The display means 134-5 reproduces images belonging to the same groupand displays them on the display unit 40. If there are voice databelonging to the same group, the voice is reproduced to output a voicemessage. If there are character data belonging to the same group, acharacter message is displayed together with the reproduction image.

In the case that after a certain processing of the above-mentionedprocessings ends the processing flag for the processing is turned off(=0) and the processing flags for the other processings are on, theprocessing is automatically performed. Such action is repeated until allprocessing flags are turned off.

Not only transmission, printing and display in each group unit but alsothose in each image unit can be performed in the same way as theabove-mentioned movement and deletion.

<Example of Operation>

(1) Example of Operation at the Time of Registering an Image GroupAutomatically

FIG. 11 is a flowchart showing an example of operation at the time ofregistering an image group automatically.

In FIG. 11, the initial photography mode is set to the normal mode. Thephotography mode is examined, and if the photography mode is notchanged, the operation is transited to the step S3 (S1). If it ischanged, the photographing flag is set to a value corresponding to a newphotography mode and the value is stored in the RAM (S2). Next, thenumber that “1” is added to the present group number is set as a newgroup number (S3).

When the shutter button is operated (S4), the value of the photographingflag stored in the RAM is examined (S5). In the case that it means thenormal photography mode, a photography is taken to store an image datatemporarily in the DRAM 14 (S6).

Next, the image data which is temporarily stored in the DRAM 14 is readand subjected to compression processing to record the data in the flashmemory 51. Moreover, the stored address of the image data and the dateof photographing in the flash memory 51, and the group number stored inthe RAM are registered in the group information list 60, and then theoperation is transited to the step S20 (S7).

In the case that the value of the photographing flag does not mean thenormal photography but continuous photography mode in the step S5,photographing action is performed by the number of times of thecontinuous photography so as to temporarily store image data aboutframes photographed in sequence in DRAM 14 (S9 and S10). After thephotographing action is performed by the number of times of thecontinuous photography, the following operation is repeated by thenumber of times of the continuous photography: the image data stored inthe DRAM 14 are read one frame by one frame, subjected to datacompression processing, and recorded in the flash memory 51; and inaddition, the stored address and date of photographing of the image datain the flash memory 51, and the group number stored in the RAM areregistered in the group information list 60. Thereafter, the operationis transited to the step S20 (S11).

In the case that the value of photographing flag does not mean thecontinues photography but panoramic photography mode in the step S8,photographing action is performed by the number of times of thepanoramic photography so as to temporarily store image data about framesphotographed in sequence in DRAM 14 (S13 and S14). After thephotographing action is performed by the number of times of thepanoramic photography, the following operation is repeated by the numberof times of the panoramic photography: the image data stored in the DRAM14 are recorded one frame by one frame, subjected to data compressionprocessing, and recorded in the flash memory 51; and in addition, thestored address and date of photographing of the image data in the flashmemory 51, and the group number stored in the RAM are registered in thegroup information list 60. Thereafter, the operation is transited to thestep S20 (S15).

In the case that the value of the photographing flag does not mean thepanoramic photography but close-up photography mode in the step S12, theimage data temporarily stored in the DRAM 14 are read, subjected to datacompression processing, and recorded in the flash memory 51. Moreover,the stored address and date of photographing of the image data in theflash memory 51, and the group number stored in the RAM are registeredin the group information list 60. Thereafter, the operation is transitedto the step S20 (S18).

In the case that the value of the photographing flag does not mean theclose-up photography mode, the image data resulting from the photographyare recorded in the flash memory 51, and then the operation is transitedto the step S20 (S19). When the photography is wholly finished, theoperation is finished. If not so, the operation is returned to the stepS1 (S20).

(2) Example of Operation When the User Sets a Group

FIG. 12 is a flowchart showing an example of operation when the usersets a group.

When the group setting mode is selected after taking photographs or atthe time of reproducing recorded images (T1), group selecting menus asshown in FIG. 4 are displayed on the screen for displaying the images,to urge the user to select a suitable menu (T2).

Group-Designating

The result of the selection by the user is examined. In the case thatother than the guide “the same group” is designated, the operation istransited to the step T8 (T3). In the case that “the same group” isdesignated, input guides as shown in FIG. 5A are displayed to urge theuser to designate a group number (T4).

At the time of pointing the group number of the presently-displayedimage, the user points the number inside the parentheses [ ] ([6] in theexample shown in FIG. 5A), while at the time when the user would like tochange the group number to a desire number or would like the displayedimage to belong to a group resulting from grouping which was alreadyperformed, the user points the symbol “+” or “−” and then points, if adesired number is displayed, the number (T5). When the user points theguide “correct”, the operation is returned to the step T4 (T6). When theuser points the guide [confirm], the pointed number is registered as agroup number in the group information list. After the registration, theoperations is returned to the step T2, and the program waits fordesignation of grouping the next image (T7).

(Search of an Original Image Candidate for Grouping)

In the case that the menu “the same group” is not designated in the stepT3, it is examined whether the guide “original image” is designated ornot. If not so, the operation is transited to the step T14 (T8). If the“original image” is designated, as shown in FIG. 5B the image datarecorded in the flash memory 51 is subjected to expansion processing andsubsequent scaling-down processing (T9). The scaled-down image isreproduced and then the symbols “+” and “−”, together with, if any, thegroup number of the recorded images are displayed with thepresently-displayed image (T10).

In the case that the user would like the presently-displayed image tobelong to the recorded group images or to be grouped into the recordedimages and its group number is unclear, the user points the symbol “+”or “−” a to quickly forward and display the scaled-down images as anoriginal image candidate. When a desired scaled-down image (=theoriginal image) is displayed, the scaled-down image is pointed (T11). Inthe example shown in FIG. 5B, a scaled-down image of a leaf of a ginkgohaving the group number [18] is displayed as the original imagecandidate.

When the user points the guide. “correct”, the processing is returned tothe step T9 (T12). When the user points the guide [confirm], the pointednumber is registered as the group number of the displayed image of asteamship in the group information list. The processing is returned tothe step T2, and then the program waits for designation of grouping thenext image (T13).

(Grouping a Voice Message)

In the case that the guide “original image” is not designated in thestep T8, it is examined whether the menu “add voice” is designated ornot. If not so, the operation is transited to the step T20 (T14). If themenu “add voice” is designated, the guide, menu or the like for urginginput of a voice message is displayed (T15).

The user points the display guide “start”, to input a voice message.When the voice input is finished, the user points the guide “end” (T16).The inputted voice is converted into voice data and stored in the voicerecording area of the flash memory 51 (T17).

When the user points the guide “confirm”, the inputted voice isreproduced. When the user points the guide “input again”, the operationis returned to the step T16 (T18). When the user points the guide [OK],the stored address and input date of the voice data, and the groupnumber of the voice data are registered in the group information list(the group number of the voice data=the group number of thepresently-displayed image of the steamship). After the registration, theoperation is returned to the step T2, and the program waits fordesignation of grouping the next image (T19).

(Grouping a Character Message)

In the case that the menu “add voice” is not designated in the step T14,it is examined whether the menu “add characters” is designated. If notso, the operation is transited to the step T26 (T20). If the menu “addcharacters” is designated or not, a guide, or menu or the like forurging input of a character message is displayed as shown in FIG. 5D(T21).

The user uses an input pen or the like in the input column on the screento input a character message or the like (T22). When the guide [end] ispointed, handwritten characters or the like are recognized and then acharacter code stream for them is stored in the character data recordingarea of the flash memory 51. When the input column is insufficient forwriting the message, the user can point the guide [continue] so as tocontinue to write the message from the upper of the input column (T23).

If the user points the guide “correct”, the operation is returned to thestep T22 (T24). If the user points the guide “end”, the pointed numberis registered as the group number of the displayed image of thesteamship in the group information list. After the registration, theprocessing is returned to the step T2, and then the program waits fordesignation of grouping the next image (T25).

In the case that the menu “add characters” is not designated in the stepT20, it is examined whether the guide “display” is designated or not. Ifthe guide “display” is designated, the screen shown in FIG. 5A continuesto be displayed. If the guide “display” is not designated, it isexamined whether the guide “end” is designated or not. If the guide“end” is designated, the grouping is finished, and if it is notdesignated, the program waits for instruction input in the step T2(S27).

If there is an image to which the same group number as thepresently-displayed image is assigned in the case that the guide“display” is designated, they may be displayed in a multi-screen orscroll-displayed.

(3) Example of Operation at the Time of Grouping

FIG. 13 is a flowchart showing an example of operation at the time ofgrouping.

When the grouping mode is selected at the time of reproducing therecorded images (U1), the image data recorded in the flash memory 51 arereproduced and displayed as shown in FIG. 6A (U2).

If the stop of quick forward is pointed to select a desired image, aprocessing selecting guide as shown in FIG. 6B is displayed togetherwith the displayed image, so as to urge the user to select grouping(U3). If the user points a desired processing or desired processings(U4), the corresponding processing flag or flags are turned on (U5). Ifthe user points the guide [informing] (U6), the group information list60′ is examined. In the case that there is an image or data of the samegroup in which the presently-displayed image is included (U7), a messagefor informing the existence of the data is displayed by characters oroutputted by voice, to inform the user of this fact. After theconfirmation thereof, the operation is transited to the step U9 (U8).

If the value of the processing flag corresponding to moving processingis off, the operation is transited to the step U17 (U9). If the value ofthe processing flag is on, a movement-instructing guide as shown in FIG.7A together with the displayed image are displayed to urge the user toinstruct a moving manner, a moving destination or the like (U10).

When the guide [group-move] is selected (U11), the group numberdesignated on the group information list is substituted by the groupnumber of the designated moving destination and then the original groupnumbers are in turn substituted so that renumbering is performed. Thus,the images etc. are moved to desired positions in a group unit. Afterthe confirmation thereof, the operation is transited to the step U17(U12).

In the case that the guide [group-delete] is selected in the step U11(U13), by inputting a group number or designating the displayed imagethe images etc. of the same group in which the image is included aredeleted at a time. Concerning the group-deleted images etc., theirprevious group number is substituted by “0” on the group informationlist 60 (U14).

If the user selects the guide “group-restore” in the step U13 (U15), thegroup number of the group-deleted images etc. and these images etc. aredisplayed/outputted. When the user points the mark [?] of the [number]guide, a new image group is automatically given to the images and storedin the group information list 60 (U16).

In the case that the processing flag corresponding to the reproducingorder changing processing is off, the operation is transited to the stepU19 (U17). In the case that the processing flag is off, if the userinputs or designates a desired reproducing order number, the reproducingorder of the group to which the displayed image belongs can be changed.When the reproducing order number is changed, the reproducing order isautomatically moved. After the confirmation thereof, the operation istransited to the step U19 (U18).

In the case that the transmitting flag is off, the operation istransited to the step U21 (U19). In the case that this flag is on, ifother images etc. belonging to the same group in which the displayedimage is included, that is, other images etc. to which the same groupnumber is assigned are stored, they together with the displayed imageare transmitted to an external device through the I/O interface 19.After the transmission, the operation is transited to the step U21(U20).

In the case that the printing flag is off, the operation is transited tothe step U23 (U21). In the case that this flag is on, if there is otherimage data about an image belonging to the same group, it is togethersubjected to expansion processing and printing data convertingprocessing, and then transmitted to the printer through the I/Ointerface 19 to perform color printing (U22).

In the case that the displaying flag is on, the operation is transitedto the step U2 so that reproduction/display is performed (U23). In thecase that this flag is off, it is examined whether grouping is ended ornot. If the grouping is not ended, the operation is returned to the stepU3 and the program waits for selection of a processing (U24).

In the above-mentioned embodiment, it is basic that in the case that aprocessing is designated for the reproduced/displayed image, if there isan image of the same group in which the displayed image is included, theprocessing is also for it. However, a processing (movement, print,transmission, deletion or the like) may be performed by designating agroup (for example, inputting a group number) directly.

In the above-mentioned embodiment, the user sets groups to images. Forexample, however, in the case that the present invention is applied toan information receiving device or an information input device, if theuser can set groups to received information or input information, thesame advantages can be obtained.

The above has described an embodiment of the present invention, but thepresent invention is not limited to the above-mentioned embodiment, andcan be carried out in various modified modes.

Additional advantages and modifications will readily occur to thoseskilled in the art. Therefore, the invention in its broader aspects isnot limited to the specific details and representative embodiments shownand described herein. Accordingly, various modifications may be madewithout departing from the spirit or scope of the general inventiveconcept as defined by the appended claims and their equivalents.

1. An image processing apparatus, comprising: storing means for storingplural photographic images; instructing means for instructing a desiredphotographic image among the photographic images stored in the storingmeans to be subjected to image processing; determining means fordetermining whether a related photographic image, which is related tothe desired photographic image, is stored in the storing means; andinforming means for informing a user when the determining meansdetermines that the related photographic image is stored, wherein thedesired photographic image and the related photographic image arerelated by one of: (i) both being included in a plurality of imageswhich are continuously photographed, and (ii) both being included in aplurality of images which are panoramically photographed.
 2. The imageprocessing apparatus according to claim 1, wherein the image processingcomprises one of: a reproducing and display processing, a storing areamoving processing, a reproducing order changing processing, a deletingprocessing, a processing for transmission to an external device, and aprinting processing.
 3. The image processing apparatus according toclaim 1, further comprising: input means for inputting information;wherein the related photographic image comprises one of a plurality ofimages which are arbitrarily grouped by the input means.
 4. An imageprocessing apparatus, comprising: a memory for storing pluralphotographic images; an input key for instructing a desired photographicimage among the photographic images stored in the memory to be subjectedto image processing; a determining section to determine whether arelated photographic image, which is related to the desired photographicimage, is stored in the memory; and an informing section to inform auser when the determining section determines that the relatedphotographic image is stored, wherein the desired photographic image andthe related photographic image are related by one of: (i) both beingincluded in a plurality of images which are continuously photographed,and (ii) both being included in a plurality of images which arepanoramically photographed.
 5. The image processing apparatus accordingto claim 4, wherein the image processing comprises one of: a reproducingand display processing, a storing area moving processing, a reproducingorder changing processing, a deleting processing, a processing fortransmission to an external device, and a printing processing.
 6. Theimage processing apparatus according to claim 4, wherein the relatedphotographic image comprises one of a plurality of images which arearbitrarily set as a group by the input key.